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Abstract — This article describes a series of new results outlin- 
ing equivalences between certain "rewirings" of interbank system 
block diagrams, and the corresponding actions of convolution, 
modulation, and downsampling operators. This gives rise to a 
general framework of reverse-order and convolution subband 
structures in interbank transforms, which we show to be well 
suited to the analysis of Interbank coefficients arising from 
subsampled or multiplexed signals. These results thus provide 
a means to understand time-localized aliasing and modulation 
properties of such signals and their subband representations — 
notions that are notably absent from the global viewpoint 
afforded by Fourier analysis. The utility of Interbank rewirings 
is demonstrated by the closed-form analysis of signals subject 
to degradations such as missing data, spatially or temporally 
multiplexed data acquisition, or signal-dependent noise, such as 
are often encountered in practical signal processing applications. 

Index Terms — Aliasing, likelihood methods, modulation, mul- 
tiplicative noise, sampling, signal enhancement, time-frequency 
analysis, wavelets. 

I. Introduction 

Since the earliest days of signal and waveform analysis, 
engineers have recognized the wide utility of parameterized 
families of filters: convolution operators that are directly rep- 
resented by finite-length sequences of real numbers. Parallel 
banks of such finite-impulse-response filters, including short- 
time Fourier and wavelet transforms, have long been a canoni- 
cal tool for analyzing signals, images, and other data sets that 
arise in a variety of applications across scientific fields [1], 
[2]. The purpose of this article is to further expand filterbank 
theory and practice by developing a general framework of 
reverse-order and convolution subband structures in filterbank 
transforms. It describes a series of new results outlining 
equivalences between certain "rewirings" of filterbank block 
diagrams, and the "localized" aliasing and modulation prop- 
erties of sampled signals and their subband representations, 
which we describe below. 

Sampled signals are typically acquired as linear functionals 
of the underlying data object of interest, which in turn is 
defined with respect to a continuous variable such as time or 
space. The actions of the convolution operators that comprise 
filterbanks are studied through their Fourier transforms, under 
the correspondence of element-wise multiplication on the dual 
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group. Since sampling a continuous-time function periodizes 
its Fourier transform, however, care must be taken that no 
information is lost in the process. Indeed, in the absence of 
additional assumptions, it is not in general possible to recover 
signals that have aliased; that is, signals whose Fourier trans- 
forms are supported on intervals so large that this periodization 
mixes distinct Fourier coefficients. 

As the bandwidth of any function is directly determined 
by its global smoothness, Fourier analysis does not lend 
itself to a meaningful analysis of signals whose smoothness 
varies and hence are not low-pass everywhere. In contrast, 
parallel banks of convolution operators with finite support are 
fundamentally local in nature. It is well known, for instance, 
that the flexibility afforded by wavelets to adapt to the local 
regularity of functions is essential in yielding the sparsity 
properties necessary for effective signal and image analysis, 
as well as contemporary signal acquisition techniques such as 
compressed sensing [3]-[8]. 

Filterbanks are hence essential engineering tools for data 
analysis. However, definitions of aliasing and frequency mod- 
ulation in the global, Fourier context preclude the closed-form 
filterbank analysis of signals subject to missing data, spatially 
or temporally multiplexed acquisition, or signal-dependent 
noise effects. While it is well known how to apply filterbanks 
to analyze, modify, and enhance signals that are free from 
aliasing or modulatory effects, the literature presently lacks a 
unified filterbank theory for these settings. 

In this work we develop a set of results necessary to fully 
understand and exploit the local aliasing and modulation prop- 
erties of sampled signals and their subband representations. 
Though our motivation stems from signal processing problems 
typically encountered in practice (such as those mentioned 
above, to which we return at the end of the article), our re- 
sults are more general, showing equivalences between certain 
"rewirings" of filterbank block diagrams, and the correspond- 
ing actions of convolution, modulation, and downsampling 
operators. Our primary contributions are the introduction and 
analysis of two cardinal rewiring mechanisms — reverse-order 
subband structure (ROSS) and subband convolution structure 
(SCS) — by which filterbank subbands are coupled together to 
describe the relationship between localized aliasing, modula- 
tion, and convolution. 

The framework we introduce is distinct from work involving 
signal recovery methods [3]-[8] and sampling theorems [9]- 
[12] in the extant literature. Such work has successfully char- 
acterized sufficient conditions for exact reconstruction when 
filterbank theory is used to restrict the class of signals under 
consideration, or to specify the fundamental compressibility of 
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Fig. 1. Pictorial illustrations of modulation and sampling in both the time 
(a-c) and frequency (d-f) domains. 



its members. In contrast, this article employs filterbank theory 
to describe the data acquisition and sampling process itself, 
rather than any properties of a given signal class. Notions 
of localized aliasing and localized modulation are intimately 
connected with the ROSS and SCS analyses that we introduce 
below, and are also complementary to other well-understood 
concepts in filterbank analysis. 

The article is organized as follows. In the remainder of 
Section I we introduce key definitions and filterbank nota- 
tion, and provide a simple example of local aliasing and 
local modulation that motivates our subsequent analysis. In 
Section [TT] we introduce our first "rewiring" notion — that of 
reverse-order subband structure — and derive corresponding 
expressions for the filterbank coefficients corresponding to 



a subsampled signal. In Section III we build on this work 



to introduce the notion of subband convolution structure — 
our second means of filterbank rewiring — and show how it 
leads to a convolution theorem particularly suited to the local 
modularity of the filterbank transform. We conclude with a 



discussion in Section IV where we consider the practical 
use of these two notions in problems involving missing data, 
multiplexed signal acquisition, and signal-dependent noise. 



A. Key Definitions and Filterbank Notation 

Throughout, let x £ £ 2 (Z) be a real-valued sequence 
indexed by n £ Z. Subsampling is the operation of replacing 
every odd-numbered element of x by zero, and hence the 
subsampled sequence x s is defined element-wise as 



Xg\n\ 



x[n] if n even, 



Q 



if n odd. 



(Note that this is distinct from downsampling, a dilation of the 
index set of x to yield a;[2n], such that odd-numbered sam- 
ples are "dropped" and only even-numbered ones retained.) 
Equivalently, x s [n] is an arithmetic average of x[n) and its 
frequency-modulated version x m [n] := (— l) n x[n].: 

x s[n] = ^ (x[n] + x m [n]) . 



x[n] — 




(a) One-level filterbank structure 

, , „ Wn In] 



x\n\ 



1 „ \n] 




(b) One-level complementary filterbank structure 

Fig. 2. One-level filterbank (a) and its complementary structure (b). 
Diagram (a) represents analysis and synthesis filters {go,gi} and {ho, hi}, 
respectively, as well as filterbank coefficient sets {vQ,vf} resulting from 
the action of the analysis convolution operator and subsequent downsampling 
on a sequence x. Reversing the downsampling procedure and applying the 
synthesis filters yields a "reconstructed" sequence x r . Diagram (b) represents 
filters §i,hi "complementary" to (a), obtained by swapping the roles of g 
and h, respectively, and then applying an affine transformation. 



Figures [TJa)-(c) serve as a reminder to illustrate how samples 
in x and x m with opposite signs cancel out to yield x s ; we 
shall frequently refer back to them later. 

Let x denote the discrete-time Fourier transform of x, with 
u> £ M/27T its corresponding normalized angular frequency. 
Then it follows that x m (u>) = x(u> — ir) and 

^sM = \ x(u>) + x(uj - 7r) . (1) 

Here we see that when the bandwidth of x — i.e., the support of 
x — is sufficiently large, x(ui) and x m (oj) are indistinguishable 
in x a (u)); as shown in Figures [TJd)-(g), their supports overlap 
in the Fourier domain. This phenomenon is called aliasing; 
in the absence of additional information, aliased portions of x 
cannot be recovered from x s (u>) alone. 

The Fourier transform is a fundamentally global operation; 
modulation and aliasing mix non-local information from the 
sequence x. In contrast, a filterbank maps a sequence x 
to some alternative representation by way of localized fil- 
terbank coefficients ("analysis"), and subsequently yields a 
linear reconstruction x r ("synthesis"); well-known examples 
include short-time Fourier and wavelet representations. As 
the analysis operator acts linearly, we write its action as 
an inner product, calling it a filter when it is a convolution 
operator parameterized by translation along a sublattice of Z, 
as is the case considered here. If this convolution operator 
is represented by the actions of a finite-length, real-valued 
sequences in £ 2 (7L\ then we refer to a real-valued, finite- 
impulse-response analysis filter g and corresponding synthesis 
filter h. Figure |2ja) illustrates a basic filterbank structure, with 
two analysis filters {g , gi} and two synthesis filters {/i , hi}. 
We denote by {vq , vf} the corresponding filterbank coefficient 
sequences, defined as follows. 

Definition 1.1 (Filterbank Coefficient Sequence): We call 
vf £ £ 2 (Z) a one-level filterbank coefficient sequence 
corresponding to x if 



:= [gi[m] * m x[m]j[2r 



(2) 
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where the summation in the discrete convolution * m is per- 
formed over the index m, and the subsequent notion of 
downsampling by two is reflected by the index set {2n : n E 
Z}. 

This composition of convolution and dilation implies in turn 
that 

1 r. 



W = 2[*(l)*(l) + *(|- ,r )*(|- ,r ) 



(3) 



and the set of transform coefficients {vf [n]}„ 6 z is collectively 
referred to as the ith filterbank subband. Typically go an d 
ho are smooth (i.e., low-pass) filters, while g\ and h\ have 
zero average. Thus, vf provides a measure of local low- 
frequency energy concentration, while vf captures local high- 
frequency energy, with temporal localization provided by 
the finite support of {<7i, /ij}iez 2 - A filterbank's joint time- 
frequency resolution can be fine-tuned by recursively nesting 
copies of the basic one-level transform structure illustrated in 
Figure |2ja), yielding the multi-level filterbank structures that 
we consider later in Section III-CI 

Note that the Fourier representation of |3]l implies the 
superposition of shifted copies of the resultant filtered spectra, 
which in general will give rise to aliasing of the type illustrated 
in Figure |TJf). It is thus natural to ask for conditions under 
which this aliasing will cancel — a prerequisite for the exact 
reconstruction of any input sequence x € £ 2 (Z) from its 
filterbank coefficients, such that x r = x in the diagram of 
Figure [2| a). To this end we arrive at the following well-known 
definition, which stems from global properties of the Fourier 
transform. 

Definition 1.2 (Perfect Reconstruction Filterbank): A per- 
fect reconstruction filterbank {gi, hi}i<=z 2 admits for all x € 
£ 2 (Z) the relation 



X(w) := h Q (u>)vf(2uj) + hi(uj)vf(2uj) = x(cj). 



(4) 



Equivalently, as shown in Figure |2ja), we have for all n G Z 
that 



x r [2n] 



x r [2n + 1] 



(h [2m] * m Uq[ 
+ (hi[2m] -k m vf [mfj [n] = x[2n] 
h [2m+l]* m vo[m])[n] 

(' 



hi [2m + 1] * m vf[m]J [n] =x[2n+l]. 
As described earlier, the sequences of operations correspond- 
ing to the forward transform step in Q and the reconstruction 
step in Q are commonly referred to as the analysis and 
synthesis filterbanks, respectively. 

Remark 1.1 (Haar Filterbank Transform): Perhaps the 
most well-known example of a perfect reconstruction 
filterbank is given by the so-called Haar transform, which 
may be defined in terms of its z-transform as: 



n 

hi[n]z~ 



=l + (-l)'*, 
1 + 



(5) 



Note that go and g\ in <|5j amount to the sum and difference 
of neighboring samples, respectively, and it is clear that 
the original sequence x[n] is easily recoverable from the 
corresponding sequences of filterbank coefficients. 

Important and well-known results associated with Definition 
1.2 established the following (see, e.g., [1]) . 

Property 1.1 (Alias Cancellation Equivalence): The set 
{gt, hi}i£Z 2 i s a perfect reconstruction filterbank if and only 
if 

2 = g (oj)ho(u>) + gi(u})hi(w) (6) 

= go{v)ho(t»J - n) + gi(w)hi(w - tt) (7) 
Property 1.2 (Analysis-Synthesis Symmetry): If finite- 
impulse-response filters {gi,hi}i£z 2 comprise a perfect 
reconstruction filterbank, then there exist a e M. \ {0} and 
b 6 Z such that 

gM = (-l^-W^Ki-itw - tt). 
Remark 1.2: The condition of (|7| in Property [TT] guaran- 
tees that the aliased components in vf and vf cancel, so 
the impulse response of the overall filterbank structure in 
Figure |2|a) is equal to one-half of the expression of d6j; i.e., 
everywhere constant and equal to unity. Property |1.2| makes 
explicit the fact that an analysis filterbank uniquely defines 
its corresponding synthesis filterbank. These properties serve 
as the foundation for the reverse-order subband filterbank 
structure that we introduce in Section UT1 below. 

B. Motivating Example for Filterbank "Rewiring" 

The preceding section has served to introduce the basic 
notions of filterbank theory that we shall employ here. Before 
continuing, it is instructive to consider a simple motivating 
example based on the simplest case of the Haar filterbank 
transform. In essence, we will see that "rewiring" filterbank 
diagrams such as those in Figure|3]can be related to the actions 
of convolution, modulation, and downsampling operators. In 
subsequent sections we develop these properties formally, and 
show how they yield new insights into important practical 
problems. 

To begin, consider the symmetric Hadamard matrix 



-1 



which maps two-dimensional vectors to the corresponding 
sums and difference of their components, and thus serves to 
define the (unnormalized) one-level Haar filterbank. Note that 
<fr -1 = i«I>, and consider two systems of linear equations in 
$ that will serve to illustrate the concepts of reverse-order 
and convolution subband structure: 



(1 


=# 


a 




s 


= * 


c 


r 


b 




t 


d 



Example 1.1 (Reverse-Ordering and Subsampling): 
Consider the first system of equations above, and suppose 
that we replace b with —b, yielding a "modulated" version of 
[a, b] T . We then observe that the Haar transform of [a, — b] T 
results in a reverse-ordering of q and r, which play the roles 
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of low-pass and high-pass components, respectively: 



"l 


1 " 




a 


1 


"1 


1 " 




' 1 1" 




<1 




r 


1 


-1 




-b 


~2 


1 


-1 




-1 1 




r 




g. 



Since summing [a, b] T and its modulated version corresponds 
to subsampling, we next compute the Haar transform of 
[a, 0] T , and observe that this results in an arithmetic averaging 
of q and r: 



1 


1 " 




a 


1 


'l 1 " 




a 




a 




q + r 


1 


-1 







_ 2 


1 -1 


( 


b_ 


+ 


-b 


H 


q + r 



We see from this simple example that the "swapping" and 
the "combining" of low-pass and high-pass components are 
reminiscent of modulation and aliasing in the traditional 
Fourier sense, as illustrated respectively in Figures [TJe) and 

W). 

Example 1.2 (Convolution and Pointwise Multiplication): 
Now consider the element-wise product of the vectors [a, b) T 
and [c, d\ T . The Haar transform of this product [ac,bd\ T is: 



1 


1 " 




ac 


1 


-1 




bd 



1 1 (q + r)(s + t) 
1 -lj [(q-r)(s-t) 
(q + r)(s + t) + (q-r)(s~t) 
(q + r)(s + t)-(q-r)(s-t) 

qs + rt 
qt + sr 



The symmetry of qs + rt and qt + sr suggests a kind of cyclic 
convolution of [q, r] T and [s, t] T . In fact, we will see in Section 
[Illjthat our filterbank rewiring techniques recover precisely this 
notion of group structure, in direct analogy to global Fourier 



analysis. In Section IV these ideas will reappear in the context 



of analysis of signals subject to multiplicative noise corruption. 

II. Reverse-Order Subband Structure and 
Localized Aliasing 

Having introduced the necessary definitions and given two 
brief examples, we now begin our technical development of 
filterbank "rewiring." Bearing in mind the examples considered 
above, we introduce in Section |II-A| below the notion of 
complementary filterbanks, and then employ them to obtain 



the following results in Section II-B the reverse-ordering of 
subband structure that results from modulation, and local- 
ized aliasing that stems from averaging the low- and high- 
frequency filterbank coefficients. In Section |II-C| we extend 
these results to the setting of multi-level filterbanks. 

A. Complementary Filterbanks 

Definition 2.1: (Complementary Filterbanks and Filterbank 
Coefficients): Let {^,/ii}i 6 z 2 be a perfect reconstruction 
filterbank. Then we define the complementary filterbank 
{gi,hi} ieZ2 as follows: 

gi[n) :=ah i [n+(2b+ 1)] 
hi[n] :=a~ 1 g 2 [n - (2b + 1)], 

where a and b are chosen to satisfy Property |1.2| of perfect 
reconstruction filterbank, and we call wf[n] a one-level com- 
plementary filterbank coefficient corresponding to a sequence 



x if 

wf[n] := [gi[m] * m x[mfj [2n]. 

The following important property of complementary filter- 
banks follows directly from Properties 1 1 . 1 1 and 1.2 of perfect 
reconstruction filterbanks. 

Proposition 2.1 (Complementarity & Perfect Reconstruction): 
If the set {gi, hi}i e % 2 is a perfect reconstruction filterbank, 
then so is {g t , /ij ie z 2 - 



Proof: Appealing to Property 1.2 we see that Fourier 



(8) 



transforms of gi and hi respectively yield 

hi{uj) =a- 1 e-^ 2b+1 ^g l (u J ). 
By substitution, we verify that |6| and |7]) hold for 

{gi, hi} l( zz 2 '- 
g (u))h (uj) + g!(uj)hi(uj) 

+ (ae^+^h^tu)) (a-ie-JW+Vgxiuj) = 2 

g (oj)h (uJ - 7r) +g 1 (bj)hi(u - n) 

= (ae^ 26+1 H (u;)) (a^e-^ 2 ^ g^u - tt)) 

+ (ae^+^h^tu)) (a^e-^+^g^LU - tt)) - 0. 

Hence by Property |l.l[ the set {gi, hi}i e z, 2 comprises a perfect 
reconstruction filterbank. ■ 
Figure |2|b) illustrates this complementary filterbank structure, 
along with the corresponding complementary coefficients wf. 
It is natural to ask if a filterbank can be its own complement, 
and to this end we have the following. 

Definition 2.2 (Self- Complementary Filterbank): We call a 
filterbank {gi, /ii}jez 2 self-complementary if 



^] = (-l) w «f[»] 



(9) 



Returning now to Remark [TTT| we note the following. 

Proposition 2.2 (Self-Complementarity of Haar Filterbank): 
The Haar filterbank is self-complementary. 

Proof: It follows from |5]) that the Haar filterbank 
satisfies the following symmetry: 

ftH = (-l)V'( 26+1 ^g*(o;), 



with a — | and b 



1.2 



of perfect 



-1. Applying Property 
reconstruction filterbanks in turn yields 

(_l)V'( 2b+1 ^.9*H =(-l) 1 ~ l ae j(2h+1)w /n_ l (w - tt) 

g*[uj) — - ahi-i(u - tt). (10) 

The well-known identity g t (uj) = (-l)V'( 26+1 ) u, pJ_ i (c<; - tt) 
of Smith and Barnwell [13] applies; and upon substituting this 
into (jTUJ, we obtain the desired result: 

=(-l) i e^ 26+1 ^(-a/i i (a;)) 
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x\n\ 



(-l) n rl^ 



L 9i 



■ x\n\ 



Fig. 3. Illustration of Theorem^ with the left side showing a modulated 
signal x m [n] and the right side showing reverse-ordering of the comple- 
mentary filterbank. The low- and high-frequency filterbank subbands for the 
modulated signal behave like the high- and low-frequency complementary 
filterbank subbands for the original signal, respectively. 



As we show below, complementary filterbanks play a key 
role in the reverse-ordering of subband structure induced by 
modulation. 



B. Reverse-Order Subband Structure 

Figure [3] illustrates the reversal of subband ordering that 
results when x is modulated by tt to yield x m : the low- 
frequency filterbank coefficient for the modulated signal 
(^Q m [n]) behaves like the high-frequency complementary fil- 
terbank coefficient for the original signal (wf [n]), and vice- 
versa. As may be seen by comparing Figure [5] with Figure [T] 
this filterbank subband "role -reversal" is consistent with the 
Fourier interpretation of modulation by tt; in both cases, the 
low- and high-frequency components are swapped, modulo- 
2tt. We formalize this notion as follows: 

Theorem 1 (Reverse-Order Subband Structure (ROSS)): If 
the set {<7i, /ij}iez 2 lS a perfect reconstruction filterbank, then 

«f m [n] = (-l) i <_ i [n]. (11) 
Proof: Modulation of x by tt implies that we have that 

1 



* (I) 

* (I) 



By Property 



1.2 of perfect reconstruction filterbanks and 



Definition [27T 

= {-if-'aS^+^h-i^ - tt) 

Of m (w) 



(-i)'^(w). 



(12) 



Applying Property |1.1| of perfect reconstruction filterbanks 
to ( p"2| ) immediately yields the following important corollary. 

Corollary 2.1 (Modulation induced by ROSS): Suppose 
the set {gi,hi}i£z 2 is a perfect reconstruction filterbank. 
Then 

=gi(w)h (w) - g a (uj)hi(u), 

2 =gi(u)h (uj - tt) - g (uj)hi(uj - tt). 
Remark 2.1 (Filterbank Interpretation of ROSS Modulation). 



An intuitive interpretation of Corollary 2.1 is that exchanging 
the low- and high-frequency filterbank subbands results 
in modulation. To see this, consider reconstruction of the 



x n 




Fig. 4. Illustration of Corollary |2.1| exchange of low- and high-frequency 
filterbank subbands results in modulation (compare to the standard comple- 
mentary filterbank structure of Figure |2Jb)). 



..0101... 



= x\n\ 





Fig. 5. Illustration of Corollary |2.2| with the left side showing x[n] subject to 
subsampling and the right side showing the corresponding aliasing structure. 
Filterbank coefficients corresponding to the subsampled signal are arithmetic 
averages of complementary low- and high-frequency coefficients. 



complementary filterbank coefficients with reverse-order 
subbands, as illustrated in Figure |4] 



x 7 .(lu) = h (w)wf(2u) — hi(u)wQ(2uj) 



1 



h (u) gx(uj)x(uj) +gi(ui- ir)x(u> - tt) 



ht(u) g a (uj)x(uj) + g (uj ~ tt)x(uj - tt) 



1 



x(uj) h (u)gi(w) - hi(u>)g (u) 



+ -x{lo - n) h (uj)gi(uJ -tt) - hi(w)gv{w - tt) 
= x(w — tt). 

We also obtain a filterbank interpretation of the aliasing 
induced by subsampling, in analogy to the Fourier decom- 
position of ([T}. As shown in Figure [5] filterbank coefficients 
corresponding to the subsampled signal x s [n] are arithmetic 
averages of low- and high-frequency coefficients correspond- 
ing to x[n], in analogy to the symmetry about tt/2 visible in 
the Figure |TJf). 

Corollary 2.2 (Localized Aliasing): If the set {gi,hi}i e z 2 
is a perfect reconstruction filterbank, then by linearity and 
Theorem [T] 



i(«J[n] + (-!)*<_ 



Furthermore, this modulation implies the filterbank subband 
symmetry vf s [n] = (— l)*ujjfjn]. 

As can be seen in Figure [5] localized aliasing occurs when 
vf [n] and wJLjn] are both simultaneously nonzero and hence 
indistinguishable in ?;f s [n]. Unlike the global Fourier aliasing 
illustrated in Figure [T] however, this aliasing is confined to a 
temporally localized region that depends on the local regularity 
of x. 
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C. Extension to Multi-Level Setting 

Multi-level filterbank analysis corresponds to a recursive 
application of convolution and downsampling operators to 
successive sets of filterbank coefficients. To index the cor- 
responding subbands, we adopt binary vector notation for 
indices as follows. Let i — (ij.i, . . . , ii, io) T <E Z 2 7 and 
i' = — io) T , and recalling vf[n] and wf[n) 

from Definitions 1 1 . 1 1 and 2.1 define the corresponding /-level 



recursions: 



* mo x[m ]J [2mi 
* mo x[m ] ) [2mi 



9h l m i\ 
[2m 2 ] 

ffij I m i] 
[2m 2 ] 



1 (ft»l m o] 
) [2m/.i]) [2n] 
1 (ffiot m o] 
Ki]) [2n] 



(13) 



(14) 



Here S Z 2 indexes the analysis filters used in the fcth-level 
decomposition (i.e. go or gi), and i' corresponds to a high 
(low) frequency subband when i is a low (high) frequency 
subband. Note here that the complementary filters g and gi 
are used only in the Oth-level decomposition in < |14) . The 
corresponding perfect reconstruction extension of Q to the 
case of an /-level filterbank is 

7-1 

£ r (w) := ^?(2 J W ) n M 2 ^)- (15) 

Then, in parallel to our earlier development, the results of 
Theorem [T] and Corollary 2.2 extend to the multi -level setting 
as follows. 

Theorem 2 (Multi-Level ROSS): Suppose the set 
{9ijhi}i£z 2 is a perfect reconstruction filterbank, and 
let i £ Z 2 7 . Then, 

v?" =(-l) i °<[n]i 

Using the same example shown in Figure [T] Figure |6]illustrates 
this localized aliasing in the multi-level filterbank setting. Note 
that although the subsampled example signal is subject to 
aliasing in a global sense (Figure |TJf)), the corresponding 
vf[n] may be recovered from w? s [n] whenever u>f/[n] = 0. 
Theorem [2] simplifies when self-complimentarity is taken into 
account, illustrated also in Figure [7] 

Corollary 2.3 (Multi-Level Self-Complementary ROSS): If 
the set {gi,hi}i£% 2 is a perfect reconstruction filterbank that 
is also self-complementary, then 



v { n 



--(-ly-^wfln], 



V T L»J = o ( v i N + v- m [n]) = - («f [n] + [n]^ 
Remark 2.2 (Extension to Discrete Wavelet Transform): 
The above results can easily be adapted to discrete wavelet 
transforms, which employ the same fundamental building 
blocks as perfect reconstruction filterbanks [1], [2]. As an 
example, the filterbank rewiring associated with the wavelet 
transform of a subsampled signal x s [n] is illustrated in Figure 
[8] we leave the details as an easy exercise for the reader. 
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(c) v, ' 
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Fig. 6. Pictorial illustration of localized aliasing in the 2-level filterbank 
domain, as indicated by Theorem [2] Parts (a-c) show filterbank coeffi- 
cients sequences corresponding to Fig. ^a-c), respectively, with (d) the 
complementary sequence corresponding to Fig. [TJa). From top to bottom, 
the ordering of the four subbands represented in each subfigure is i = 
(0, 0), (1, 0), (1, 1), (0, 1). "Rewiring" is evident in comparing (b) with (d), 
and v% [n] is exactly recoverable from v^ s [n] whenever w^, [n] = 0. 



III. Subband Convolution Structure and 
Localized Modulation 



In the previous section, we introduced and studied the 
reverse-ordering of subband structure induced by subsampling, 
for the case of general perfect reconstruction filterbanks. 
Furthermore, we saw that this structure simplified considerably 
when self-complimentarity was taken into account. In this 
section, we show that the symmetry of the Haar filterbank 
transform also affords a characterization of Fourier group 
duality and convolution. As a special case, we recover the 



multi-level ROSS structure of Corollary 2.3 thereby linking 
the ROSS results of Section [TT] and the subband convolution 
structure (SCS) we introduce below. 



A. Subband Convolution Structure 

Recall the multi-level filterbank decomposition of ( |13) , in 
which if. E Z 2 indexes pairs of analysis filters used for the 
fcth level decomposition. Below, we prove the duality of time- 
domain multiplication and subband convolution of filterbank 
coefficients in this context. 



Theorem 3 (Subband Convolution): Let vf,v\ be /-level 
Haar filterbank coefficient sequences corresponding to x and 
y, respectively, with that of the element-wise product 

xy. Then, letting © denote cyclic convolution, we have the 
relation 



1 



\ ^ 



2 i A^ v i+M yV M 
3 
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Fig. 7. Illustration of Corollary |2.3| Filterbank coefficients corresponding to the subsampled signal are arithmetic averages of reverse-order coefficients. 
Localized aliasing thus occurs when f?[n] and ui?, [n] are both supported simultaneously and hence indistinguishable in v^ s [n]. 



pT^T-Q-Q 



...oioi. r[ ^ @ _|-t 



9o 



9i 



x n — 



L 9i 



5o -© 




Fig. 8. An example of ROSS-based wavelet analysis, with the left side showing x[n] subject to subsampling, and the right side showing the corresponding 
aliasing structure. 



7-1 



Proof: By the Fourier representation of ( fl5] >, the product 
x[n] ■ y[n] can be analyzed as: 

(x ■ y){uj) = x r {u) * u y r (uj) 
7-1 

. i fe=0 

■ J —7T ^ 

■>■ 3 

Y\h lk (2 k v)h 3k (2 k (LO-v) 



where we have used the fact that J* e i 2 v f(y)dv = for 



k=0 



all f(u) E i(M/2- fc 7r) whenever k > 0, as e~^ 2 u -^f(v - 
2~ k n) = — e _j2 u ' f(v). By recursion over k, the above 
reduces to 

K-i 

n K+i& h o>) 



.fe=0 



(16) 



dv. 



It follows from the definition of the Haar filterbank transform 
in ([5} that 

ik.,\u ( ok i 



h ih (2«v)h jk [2"(uj-v) 
1 



4: L J L 

= \ [h ik+jh (2 k uj) + (-ire-^% k+jh (2 fc ( W - 21/)) 
Substituting this expression into ( fTo} for fc = 0, 

i 3 * 

ri-i 



,fe=i 



• [^ +J >) + (-l)* e -^ +J >-2i/) 
^ £ £ fco+ioM ^(2 J l /)«| (2 V - vj) 



7-1 



n^(2M^ fe (2*(w-i/) 



U-l 



_fc=0 

fl < »(2 J t /)fi?f2 J (w- I /) 



7-1 



n fc ifc (2*i/)^(2*( W - I /)) 

_k=K 

2K+1 E E 



dz/ 



K 



j Lfc=0 



(17) 



«f(2 I i/)«?(2 / (a;-i/)) 

-1 

n ^(2^)^(2^^-!/) 



,/c=7f+l 



,tEE 



dv 



2 1 



i 3 



7-1 



Y[h ik+jk (2 k uj) 



k=0 



■ [i)?(2 J u;)*^J(2V) 

Note that ( fT7] i takes the form of a multi-level inverse filterbank 
transform, as per (TT3}. As the Haar filterbank transform is one- 
to-one and onto, vf® is thus uniquely defined by 

which agrees with the claim of the theorem. ■ 

Figure [9] illustrates the corresponding "rewiring" of filter- 
bank subbands, in which vf [n] and u? [n] are coupled together 
to yield Ug^fn], and vf,[n] and vf\n] are combined to produce 
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x n\ — 



u 9i — (J) 



y[n\ 



I— 9o — <J> 



5i — (±> 




Fig. 9. Illustration of Theorem [3] showing the correspondence between 
time-domain multiplication and "logical convolution" of filterbank subbands. 



Remark 3.1 (Logical Convolution): By restricting x and y 
be finite-dimensional, we recover the so-called logical con- 
volution theorem [14] as a special case of Theorem [3] This 
is easily seen by considering an order-2 7 ^ Walsh sequence 
6s 6 R 2 and its Abelian structure: 



ill 



T T T T 



1l 
iL 



jlL 



(a) uf 



(b) «J 



(c) I). ■ 



diag(</>i) 



i>ij e 



(18) 



Orthogonality of the Walsh basis sets implies that any x £ R 2 
can be expanded in terms of its Walsh-Hadamard coefficients 



group homomorphism of 

all x,ye R 2 ': 



and hence the 



yields the desired relation for 



,diag(x)y) = 



1 

"22 
1 



3,3' 



,diag(0j) 



: 2 / zJ 

3 



B. Localized Modulation and Connection to Reverse-Ordered 
Subband Structure 



We conclude this section by interpreting the result of 
Theorem [3] in terms of amplitude modulation and sampling. 

Remark 3.2 (Multi-Level ROSS for Haar Filterbank Transform^: 
Suppose that we set vJ Q 00 )N = v Jq o = 2 /_1 for 
all n, and v\[n] = otherwise, thus yielding a Dirac comb. 
Then Theorem [3] agrees precisely with Corollary |2.3| 

(v] ®j vfj \n]=- (vf [n] + v% [n]) . 
Remark 3.3 (Generalized Subsampling): More generally, 
suppose y[n] G {0, 1} is a sampling mask of any kind. 
Then it may be seen from Figure [9] that the subsampled 
signal af[n]y[n,] is aliased if Wg[n]uQ[n] and wf[n]uf[n] (or, 



Fig. 10. Pictorial illustration of localized modulation in 2-level filterbank 
domain. Time-domain multiplication of x and y, represented by their filter- 
bank coefficients in (a) and (b), results in subband convolution, shown in (c); 
"rewiring" is evident in comparing (a) and (c). Exact recovery of v?[n] from 
v^ y [n] is possible when the supports of [n] are mutually exclusive for 
all i and j corresponding to nonzero [n] and v J [n] . 



Formally, we are concerned with characterizing a sum 
z[n] = ajfe[n]j/fc[n] of modulated sequences Xk- When the 
"envelope function" yk[n] is chosen carefully, then it follows 
from Theorem [3] that these signals are recoverable. 

Proposition 3.1 (Localized Amplitude Modulation): 
Suppose yk[n] is defined by a sequence of index 
values jk S and Haar filterbank coefficients: 

= &{i>jk[ n ])- Then Xk[n] is recoverable from 
Z N = Y,k x k[ n ]yk[n] when the supports of v^ jk[n] [n] are 
mutually exclusive for all i and k. 

Proof: By the subband convolution result of Theorem [3] 



k 



V ■ 
3 



However, by the assumed mutual exclusivity of the supports 
of v x * . , ,fnl, it follows that 



i+jk [n] 



if there exists k with nonzero v Xk ■ , , 

l +3fcN 



otherwise, 

and thus we conclude that t>? fc [n] 
v v - k \n] is nonzero. 



v 



i+jk [n 



[n] whenever 



t'n n v; n 



and Vq [n]v\[n]) are simultaneously supported. 



Remark 3.4 (Localized Modulation): Consider Figure [9] 
again and suppose at time n — 0, we have that vf^n] = 
and v\[n] — 1. Then Vq[ti] is "modulated" to u^ y [n]. This 
is similar to Fourier amplitude modulation, in which case 
the energy of the modulated signal is concentrated around 
a chosen carrier frequency; however, a representation based 
on Theorem [3] is amenable to temporally local processing. 
For example, suppose at time n = 1, we take Vq[ti] = 1 and 



[n] = 0; then v x [n] is mapped to 



X II i 
'1 y 



instead of v 1 



:ryr 



In other words, this filterbank interpretation of localized 
modulation — illustrated in Figure [10] — is ideal for tracking 
modulation when the "carrier" y[n] is allowed to change over 
time. 



IV. Discussion: Implications for Signal Analysis 

The preceding two sections have explored properties of 
reverse-order and convolution subband structure (ROSS and 
SCS) in filterbanks, and shown their relation to the concepts 
of localized aliasing and modulation. We now discuss the 
practical implications of these results for signal analysis, and 
provide two brief demonstrations that "rewiring" filterbank 
diagrams in the manner of ROSS and SCS can enable new 
solutions to problems involving subsampled data corrupted by 
additive or multiplicative noise. As many scientific and engi- 
neering applications give rise to inverse problems involving 
subsampled and/or noisy data, and since filterbanks are the 
tool of choice for many signal and image processing tasks, it 
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is natural to analyze the data likelihoods resulting from these 
problems directly in the filterbank coefficient domain. 



A. Filterbank- Domain Likelihoods via ROSS and SCS 

While data likelihoods often do not admit straightforward 
closed-form expressions through traditional filterbank analysis, 
the ROSS and SCS concepts provide a new way to characterize 
signals subject to aliasing or signal-dependent noise effects 
directly in the filterbank coefficient domain, by virtue of the 
associated filterbank rewiring techniques. The expression of 
filterbank data likelihoods is key to solving signal recon- 
struction and enhancement problems in this context; as signal 
acquisition models, these likelihoods may be coupled with 
regularization terms that encourages parsimony as a means of 
signal modeling, reflected through prior probability densities 
on filterbank coefficients, or equivalently through terms that 
explicitly penalize complexity. To this end, the following two 
corollaries show how explicit likelihood formulations follow 
directly from application of the ROSS and SCS concepts 
introduced earlier. 

Corollary 4.1 (Noisy, Sub sampled Data Likelihood): Fix 
x E £ 2 (Z) as the signal of interest, and let £ comprise 
samples of white Gaussian noise of variance a 2 . Suppose 
then that we observe subsampled, noisy data y = x s + £ s 
and subsequently apply a unitary filterbank transform; then 
it follows from the localized aliasing relation of Theorem [2] 
that the analysis filterbank coefficients of y satisfy 

_ v*[n] + (-iy°wl[n) v^n} + (~iyowi[n} 
«il»J- 2 + 2 

and hence each admits a Normal likelihood with mean 
(vf[n] + (-l) io w?,[n})/2 and variance a 2 /2. 

Corollary 4.2 (Multiplicative Noise Data Likelihood): 
Suppose instead that the observation model y[n] = 
x[n] + x[n]£[n] is in force. Then the subband convolution 
structure of Theorem [3] implies the filterbank coefficient 
relation 



v v An] =vf\n] + 



0« 



n\ ®j [n\ 



and hence the likelihood form of v![ [n] is multivariate Normal 
with mean wf[n], where the covariance of v\\n] and w|[n] is 
given by a 2 (v% ® k v%) i+j . 



B. Proof of Concept: Application to Image Interpolation and 
Denoising 

The likelihood expressions of Corollaries |4.1| and |4.2| 
above extend straightforwardly to the case of separable two- 
dimensional filterbank transforms, which in turn are typically 
employed in imaging applications. Thus, to illustrate the 
practical applicability of these results, we now undertake two 
proof-of-concept experiments that are representative of prob- 
lems frequently encountered in digital imaging, and for which 
our ROSS and SCS characterizations — in contrast to standard 
approaches — yield closed-form likelihood expressions for the 
corresponding filterbank coefficients. 



The first of these — image interpolation in the presence 
of noise — is made difficult by the fact that low- and high- 
frequency filterbank subbands interact with one another as well 
as with the noise itself; the "rewiring" expression of Corollary 
4. 1 in turn provides a closed-form likelihood expression for the 
filterbank coefficients. In the second experiment, we consider 
the similarly difficult problem of mitigating multiplicative 
noise; in this case, Corollary 4.2 yields the corresponding 
likelihood. 

As filterbank coefficients of images typically exhibit sparsity 
[15], one natural approach to utilize these likelihoods through 
a Bayesian framework, in which transform coefficients of the 
underlying image x are modeled as random variables u^n] 
taking zero-mean, symmetric, and unimodal "heavy-tailed" 
distributions that exhibit super-Gaussian tail behavior [16], 
[17]. We assume such a prior distribution here, and evaluate 
posterior means numerically via Monte Carlo averages. 

We follow typical practice in approximating the overall joint 
posterior distribution of all filterbank coefficients by a product 
of marginal distributions, where each marginal posterior is 
associated with a particular subband. In turn, the £ 2 -optimal 
estimator of filterbank coefficients vf [n] corresponding to the 
ith subband given the corresponding data coefficients v\ [n] is 
given by 



E[v. 



x, V] = I ' v !p(v V i\ v iM v ?) dv i . 
1 P(v?) 



(19) 



the corresponding synthesis filterbank in turn allows recon- 
struction of the estimated image. 

We first consider a well-known 8 -bit test image that has been 
artificially downsampled and degraded with additive white 
Gaussian noise of variance 400 to yield a signal-to-noise ratio 
(SNR) of 16.77 dB relative to x s (or 1.22 dB relative to x), 
as shown in Figures (TJJa) and [TJJb). Figure [TTjc) shows the 
corresponding image reconstruction, which retains much of 
sharpness of the image edges and textures while suppressing 
noise, resulting in an SNR gain of 3.81 dB. For purposes 
of comparison, Figure [TTJd) shows the result of the recently 
proposed simultaneous interpolation and denoising method of 
[18], which yields an SNR gain of 3.55 dB; this reconstruction 
exhibits edges that are more strongly preserved, but at the 
expense of greater smoothing of image textures. 

In our second experiment, we consider a synthetic aperture 
radar (SAR) image, available at www.sandia.gov/radar; as may 



be seen from Figure 12 a), such images suffer from the effects 



of multiplicative noise [19]. Figure 12 b) shows the enhanced 
image resulting from a "rewiring" approach, which exhibits 
reduced noise in smooth and textured regions, and avoids the 



introduction of artifacts. In contrast, Figure 12 c) illustrates the 



standard approach: application of a logarithmic transformation 
to the data, followed by an additive denoising technique (here 
the well-known method of [16]) and subsequent exponentia- 
tion of the result. Not only are Bayes optimality properties 
of [16] lost in the exponentiation transformation back to the 
pixel domain, but also substantial artifacts are seen to result 
from this standard approach. 
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(a) Original test image 



(b) Subsampled, noisy test image 




(c) "Rewiring" reconstruction 



(d) Reconstruction via the method of [18] 



Fig. 11. Example of noisy image interpolation via the ROSS technique of Section [II] The first row shows a full-resolution 8-bit test image (a), along with 
a subsampled version that has been degraded with additive white Gaussian noise of variance 400 (b). The bottom row shows a posterior mean reconstruction 
based on the filterbank-domain likelihood of Corollary |4.1| and a heavy-tailed prior distribution on filterbank coefficients (c), along with a reconstruction 
according to the recently proposed method of [18], shown for comparison (d). 



C. Concluding Remarks 

In conclusion, we have shown in this article how filterbank 
"rewirings," corresponding to compositions of convolution, 
modulation, and downsampling operators, admit expressions 
of localized aliasing and modulation, in directly analogy to the 
global setting of Fourier analysis. In addition to establishing a 
number of results that formalize reverse-order and convolution 
subband structures in filterbank transforms in Sections [IT] and 



III respectively, we have demonstrated in this section how 



these concepts in turn enable the establishment of closed- 



form likelihood functions for the direct filterbank analysis 
of signals subject to degradations such as missing data, spa- 
tially or temporally multiplexed data acquisition, or signal- 
dependent noise, such as are often encountered in practical 
signal processing applications. 
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(a) SAR image showing "speckled noise" (b) "Rewiring" enhancement (c) Enhancement via the method of [16], applied 

after logarithmic transformation 

Fig. 12. Example of multiplicative noise mitigation via the SCS technique of Section |III| Panel (a) shows a portion of SAR imagery data in which 
noise is visibly present. Panel (b) shows an enhancement based on the filterbank-domain likelihood of Corollary |4.2| and a heavy-tailed prior distribution on 
filterbank coefficients, with panel (c) showing for comparison an enhancement according to the method of [16], designed for additive noise and applied after 
a variance-stabilizing logarithmic transformation. 



kindly providing their code for the purpose of comparative 
evaluation. 
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